Bimodal Emotion Recognition
نویسندگان
چکیده
Recent technological advances have enabled human users to interact with computers in ways previously unimaginable. Beyond the confines of the keyboard and mouse, new modalities for human-computer interaction such as voice, gesture, and force-feedback are emerging. Despite important advances, one necessary ingredient for natural interaction is still missing emotions. This paper describes the challenging problem of bimodal emotion recognition and advocates the use of probabilistic graphical models when fusing the different modalities. We test our audio-visual emotion recognition approach on 38 subjects with 11 HCI-related affect states. The experimental results show that the average persondependent emotion recognition accuracy is greatly improved when both visual and audio information is used in classification.
منابع مشابه
Research of Emotion Recognition Based on Speech and Facial Expression
The paper introduced the present status of speech emotion recognition. In order to improve the single-mode emotion recognition rate, the bimodal fusion method based on speech and facial expression was proposed. The emotional databases of Chinese speech and facial expressions were established with the noise stimulus and movies evoking subjects' emtion. On the foundation, we analyzed the acoustic...
متن کاملCombining Audio and Video by Dominance in Bimodal Emotion Recognition
We propose a novel bimodal emotion recognition approach by using the boosting-based framework, in which we can automatically determine the adaptive weights for audio and visual features. In this way, we balance the dominances of audio and visual features dynamically in feature-level to obtain better performance.
متن کاملSpeaker-Dependent Human Emotion Recognition in Unimodal and Bimodal Scenarios
This paper presents an efficient technique of human emotion recognition using the audio and visual modalities for the speaker-dependent scenario. To achieve better emotion classification different audio and visual features were extracted. The feature selection was performed using the Plus -Take Away algorithm based on two criteria: Mahalanobis distance and KL-divergence. The feature selection w...
متن کاملAudio-Visual Emotion Recognition Using Semi-Coupled HMM and Error-Weighted Classifier Combination
This paper presents an approach to automatic recognition of emotional states from audio-visual bimodal signals using semi-coupled hidden Markov model and error weighted classifier combination for Human-Computer Interaction (HCI). The proposed model combines a simplified state-based bimodal alignment strategy and a Bayesian classifier weighting scheme to obtain the optimal solution for audio-vis...
متن کاملSurvey on audiovisual emotion recognition: databases, features, and data fusion strategies
Emotion recognition is the ability to identify what people would think someone is feeling from moment to moment and understand the connection between his/her feelings and expressions. In today’s world, human–computer interaction (HCI) interface undoubtedly plays an important role in our daily life. Toward harmonious HCI interface, automated analysis and recognition of human emotion has attracte...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005